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"The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 

THE REPLY FILED 19 September 2007 FAILS TO PLACE THIS APPLICATION IN CONDITION FOR ALLOWANCE. 



1. El The reply was filed after a final rejection, but prior to or on the same day as filing a Notice of Appeal. To avoid abandonment of 

this application, applicant must timely file one of the following replies: (1) an amendment, affidavit, or other evidence, which 
places the application in condition for allowance; (2) a Notice of Appeal (with appeal fee) in compliance with 37 CFR 41 .31 ; or (3) 
a Request for Continued Examination (RCE) In compliance with 37 CFR 1.114. The reply must be filed within one of the following 

time periods: 

a) S The period for reply expires 3_months from the mailing date of the final rejection. 

b) C] The pferiod for reply expires on: (1) the mailing date of this Advisory Action, or (2) the date set forth in the final rejection, whichever is later. In 

no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of the final rejection. 

Examiner Note: If box 1 is checked, check either box (a) or (b). ONLY CHECK BOX (b) WHEN THE FIRST REPLY WAS FILED WITHIN 

TWO MONTHS OF THE FINAL REJECTION. See MPEP 706.07(f). 
Extensions of time may be obtained under 37 CFR 1.136(a). The date on which the petition under 37 CFR 1.136(a) and the appropriate extension fee 
have been filed is the date for purposes of determining the period of extension and the corresponding amount of the fee. The appropriate extension fee 
under 37 CFR 1.17(a) is calculated from: (1) the expiration date of the shortened statutory period for reply originally set in the final Office action; or (2) as 
set forth in (b) above, if checked. Any reply received by the Office later than three months after the mailing date of the final rejection, even If timely filed, 
may reduce any earned patent term adjustment See 37 CFR 1.704(b). 
NOTICE OF APPEAL 

2. □ The Notice of Appeal was filed on . A brief in compliance with 37 CFR 41 .37 must be filed within two months of the date of 

filing the Notice of Appeal (37 CFR 41 .37(a)), or any extension thereof (37 CFR 41 .37(e)). to avoid dismissal of the appeal. Since 
a Notice of Appeal has been filed, any reply must be filed within the time period set forth in 37 CFR 41 .37(a). 
AMENDMENTS 

3. □ The proposed amendment(s) filed after a final rejection, but prior to the date of filing a brief, will not be entered because 

(a) D They raise new issues that would require further consideration and/or search (see NOTE below); 

(b) □ They raise the issue of new matter (see NOTE below); 

(c) D They are not deemed to place the application in better form for appeal by materially reducing or simplifying the issues for 

appeal; and/or 

(d) □ They present additional claims without canceling a corresponding number of finally rejected claims. 

NOTE: . (See 37 CFR 1 .1 16 and 41 .33(a)). 

4. □ The amendments are not in compliance with 37 CFR 1.121. See attached Notice of Non-Compliant Amendment (PTOL-324). 
5' n Applicant's reply has overcome the following rejection(s): . 

6. □ Newly proposed or amended claim(s) would be allowable if submitted In a separate, timely filed amendment canceling the 

non-allowable claim(s). 

7. □ For purposes of appeal, the proposed amendment(s): a) □ will not be entered, or b) □ will be entered and an explanation of 

how the new or amended claims would be rejected is provided below or appended. 
The status of the claim(s) is (or will be) as follows: 

Claim(s) allowed: . 

Claim(s) objected to: . 

Claim(s) rejected: . 

Claim(s) withdrawn from consideration: . 

AFFIDAVIT OR OTHER EVIDENCE 

8. □ The affidavit or other evidence filed after a final action, but before or on the date of filing a Notice of Appeal will not be entered 

because applicant failed to provide a showing of good and sufficient reasons why the affidavit or other evidence is necessary and 
was not eariier presented. See 37 CFR 1 .1 16(e). 

9. □ The affidavit or other evidence filed after the date of filing a Notice of Appeal, but prior to the date of filing a brief, will not be 

entered because the affidavit or other evidence failed to overcome ati rejections under appeal and/or appellant fails to provide a 
showing a good and sufficient reasons why it is necessary and was not eariier presented. See 37 CFR 41 .33(d)(1). 

10. □ The affidavit or other evidence is entered. An explanation of the status of the claims after entry is below or attached. 
REQUEST FOR RECONSIDERATION/OTHER 

1 1 . □ The request for reconsideration has been considered but does NOT place the application in condition for allowance because: 

12. □ Note the attached Information Disclosure Statement(s). (PTO/SB/08) Paper No(s). 

13. la Other: See Continuation Sheet Dfiim>^X^P&^^ 



U.S. Patent and Trademark Office 

PTOL-303 (Rev. 08-06) Advisory Action Before the Filing of an Appeal Brief Part of Paper No. 20071 009 



Cr^trhuation Sheet (PTO-303) 



Application No. 10/806,090 



Continuation of 13. Other: The Applicant's arguments have been fully considered but are not persuasive. Prosecution has been closed 
upon the Final Office Action 

In reference to the Applicants arguments on page 3 regarding the "plurality of vectors", the claim reads "...so that the neurons handle a 
plurality of different input vectors...". The Examiner considers that if the system is used at different times and each time a different input 
vector is provided to the neural network, then a plurality of different input vectors are provided to the neural network and the neurons are 
handling different input vectors each time the system operates. 

In reference to the arguments on page 3 regarding the plurality of modalities, in figure 2 of Hatayama, the neurons in the input layer of the 
neural network receive different types of data (modalities) including camera information (visual modality) and voice information (auditory 
information). The input layer is connected to the intermediate layer and the intermediate layer is connected to the output layer. Since the 
neural network processes the information from input to output, all of the neurons in the network must be able to operate on the data 
received in the input layer and therefore all will have the "modalities" to operate on the different data received in the input layer. 
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